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METHOD AND APPARATUS FOR DIFFERENTIAL ILLUMINATION 
IMAGE- CAPTURING AND DEFECT HANDLING 

TECHNICAL FIELD OF THE INVENTION 

This invention relates to the field of image processing, 
and more particularly to a method and apparatus for 
differential illumination image-capturing and defect handling. 

5 

BACKGROUND OF THE INVENTION 

Image scanners, such as flatbed scanners, are widely used 
to convert documents, such as papers, images, photographs, 
negatives and the like, into electronic representations of the 

10 document or digital images. This is typically done by placing 
the document on a glass platen, illuminating the document with 
visible light and moving an imager relative to the document to 
record the intensity of light reflected from each minute 
location of the document arid to process that information to 

15 form the digital image of the document. The digital image can 
then be stored, altered electronically, or printed. 

A drawback of a conventional scanning system is that 
defects on the document such as dust, lint, and scratches, as 
well as defects in the scanning system, such as platen 

2 0 scratches, smudges, dust and fingerprints result in a degraded 

electronic representation or digital image. Also, when 
scanning matte finished photographs, many conventional 
scanners have a tendency to produce lines in the digital 
image. This is because matte finished photographs have a 
25 raised surface texture that causes shadows to be cast in 
between the raised area. 

SUMMARY OF THE INVENTION 

Accordingly, it may be appreciated that a need has arisen 

3 0 for a method and system for reducing defects in a digital 

image. In accordance with the teachings of the present 
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invention, a method and system for differential illumination 
image -capturing and defect handling is provided which 
substantially eliminates or reduces the disadvantages and 
problems associated with conventional imaging systems. 
5 In one embodiment of the present invention, an image 

processing system is provided. The system includes a first 
light source operable to illuminate a document in a first 
direction and a second light source operable to illuminate the 
document from a second direction. Also included is a sensing 

10 device operable to detect light from the first and second light 
sources after interaction with' the document. A processor 
receives information from the sensing device and produces an 
image and image defects . 

In another implementation of the present invention, a 

15 method for determining defects on a document is disclosed. In 
a first step, a first image record based on light influenced 
by the document from a first light source is obtained. In a 
second step, a second image record based on light influenced 
by the document from a second light source is obtained. Next, 

2 0 a maximum pixel intensity record is obtained by comparing the 

first and second image records and selecting the highest pixel 
intensity value for a given pixel location. Then, a minimum 
pixel intensity record is obtained by comparing the first and 
second image records and selecting the lowest pixel intensity 
25 value for a given pixel location. Next, a difference record is 
obtained by subtracting the minimum pixel intensity record from 
the maximum pixel intensity value. Next, the center of a 
defect region is obtained by locating localized minimums in the 
difference record. Finally, defect boundaries are determined 

3 0 based on the difference record. 

The present invention provides various technical 
advantages over conventional imaging systems. For example, one 
technical advantage is that the effects of defects can be 
substantially removed from a digital image. Another technical 
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advantage is that documents with textured surfaces can be 
scanned more accurately then with many conventional systems. 
Another technical advantage is that at least two image 
datasets, corresponding to illumination from at least two 
5 separately illuminated light sources can be acquired. Other 
technical advantages will be readily apparent to one skilled 
in the art from the following figures , descriptions and claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 For a more complete understanding of the present invention 

and the advantages thereof, reference is now made to the 

following description taken in conjunction with the 

accompanying figures, in which like reference numbers represent 

like parts and in which: 
15 FIGURE 1 illustrates one embodiment of an image defect 

correction system in accordance with the teachings of the 

pre sent invent ion ; 

FIGURE 2 illustrates the components of a data-processing 

system in accordance with the teachings of the present 

2 0 invention; 

FIGURE 3 is a flowchart illustrating the overall operation 
of the image defect correction system in accordance with the 
teachings of the present invention; 

FIGURE 4 is a flowchart illustrating the capturing of a 
25 digital image in accordance with the teachings of the present 
invention; 

FIGURE 5a is a simplified illustration of the image defect 
correction system, FIGURE 5b illustrates a document illuminated 
by a first light source, FIGURE 5c illustrates a document 

3 0 illustrated by a second light source, FIGURE 5d illustrates a 

defect map; 

FIGURE 6a is a density plot illustrating pixel intensity 
when illuminated from a first light source, FIGURE 6b is a 
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density plot illustrating pixel intensity when illustrated from 
a second light source; 

FIGURE 7 is a flowchart illustrating the processing of 
forming digital images in accordance with the teachings of the 
5 present invention; 

FIGURE 8a is a density plot illustrating a maximum pixel 
intensity for a pixel location, FIGURE 8b is a density plot 
illustrating a minimum pixel intensity for a pixel location; 
FIGURE 8c is a density plot formed by subtracting the maximum 
10 values from the minimum values; FIGURE 8d is a density plot 
illustrating a defect region; 

FIGURE 9 illustrates an embodiment that captures data from 
a transparent medium in accordance with the teachings of the 
pre s ent invent i on ; 
15 FIGURE 10 illustrates an embodiment that captures data 

from a reflective medium using a mirror as a second light 
source in accordance with the teachings of the present 
invention; 

FIGURE 11 illustrates an arrangement of three light 
2 0 sources used with a drum scanner in accordance with the 
teachings of the present invention; and, 

• FIGURE 12 illustrates another arrangement of four light 
sources used with a flatbed scanner in accordance with the 
teachings of the present invention. 

25 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 illustrates one embodiment of the image defect 
correction system 10 in accordance with the teachings of the 
present invention. System 10 includes a scanner 16 that 
30 operates to capture data from a document 12, such as paper, 
images, negatives, photographs or any other reflective medium. 
Scanner 16 can be a line scanner, a flatbed scanner or other 
suitable type of imaging system. An example of such a scanner 
is the EPSON™ 836 scanner. The data captured from system 10 
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is generally processed by an external data-processing system 
18 . An example of such a data-processing system is a general 
purpose computer, such as a personal computer, that operates 
using program instructions to carry out the operations and 
5 functions discussed herewithin. 

Scanner 16 generally includes a glass or similarly clear 
platen 22. Document 12, the document to be scanned, is placed 
on top of platen 22. Document 12 has an image side 12a, which 
will be digitally recorded by scanner 16. Scanner 16 further 

10 comprises an imaging subsystem 24. In this embodiment, imaging 
subsystem 24 includes a first light source 26, a second light 
source. 28, and a sensing device 30. Sensing device 30 is 
operable to capture image data from image side 12a produced by 
light reflected from first light source 26 and light reflected 

15 from second light source 28. In one embodiment, sensing device.. 
30 comprising a detector 32 and an optical system 34. Optical 
system . 34 is operable to focus the reflected light from 
document 12 onto detector 32 in such a manner that detector 32 
can record the image data from document 12 . In a particular. 

20 embodiment, detector 32 is a charge coupled device (CCD) . 
However, detector 32 maybe any suitable type of light sensing 
device. For example, detector 32 may be a CMOS detector, a 
photoresistor , a phototransistor and the like. As is well 
known in the art, the detector 32 will, for a color image, have 

25 distinct red, green and blue sensor portions. Note that red, 
green and blue is meant to be any equivalent representation of 
those colors in any color space such as CMYK, XYZ, LAB, or any 
other equivalent color space. Color spaces are different ways 
to represent the red, green and blue colors. 

30 Depending on the type of detector 32 used, scanner 16 may 

further comprise an analog signal processor 3 6 and an analog- 
to-digital converter 38. Analog signal processor 36 and analog 
to digital converter 38 are needed if sensing device 30 outputs 
an analog signal in order to convert the analog signal to a 
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digital signal for processing and storage. Also included with 
scanner 16 is a power supply 40, a first electronic switch 42, 
and a second electronic switch 44. First electronic switch 42 
is operable to control first light source 2 6 and second 
5 electronic switch 44 is operable to control second light source 
28. Transport mechanism 46 is used to control the movement of 
imaging subsystem 24. Controller 48 controls first electronic 
switch 42, second electronic switch 44, and transport mechanism 
46. Controller 48 is, in one embodiment, a programmable micro- 

10 controller such as a MC68HC05 made by Motorola. 

In one embodiment, first light source 26 and second light 
source 28 are implemented as fluorescent light sources. In a 
particular embodiment first light source 26 and second light 
source 28 are positioned on opposing sides of a scan line 50, 

15 as illustrated in FIGURE 1. In this embodiment, each light 
source, first light source 26 and second light source 28, are 
illuminated at separate times. In operation, illumination from 
first light source 26 will illuminate image side 12a of 
document 12 and will also illuminate any defects on image side 

20 12a of document 12 and/or platen 22. The illumination of 
defects will create effects (such as shadows) towards the 
right. Similarly, light from second light source 28 will 
illuminate image side 12a of document 12 and cause defects to 
create effects towards the left. Sensing device 30 will 

2 5 capture the image data created by each of the light sources 
including image information and defect effect information. 

First light source 26 and second light source 2 8 produce 
light in accordance with application of power from power supply 
40 via first electric switch 42 and second electric switch 44. 

30 Controller 48 connects to first electronic switch 42 via 
control 'line C-2 and second electronic switch 44 connects to 
controller 48 via control line C-l. In this manner, controller 
48 can control the operation of first electronic switch 42 and 
second electronic switch 44. First electronic switch 42 and 
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second electronic switch 44 can comprise transistors and/or 
relays or other devices well known in the art to control 
illumination from a light source. In a typical application, 
only two states (or levels) of light are needed. For example, 
5 when the light sources are fluorescent lamps, the two states 
are a low intensity level and a high intensity level. This is 
due to the fact that since fluorescent lamps take a long time 
to warm up they are usually left in a low intensity level when 
not in use. Therefore, when a light source is in the off 

10 position, in one embodiment, the light source is actually 
illuminated at a low intensity. The on state represents a 
higher intensity level than the off state. With light sources, 
other then fluorescent light source, off may actually be a^ 
state where there is no illumination. For the purposes of the- 

15 present invention, the on state represents a higher intensity, 
level than the off state. Other states may be used for 
calibration purposes or for specialized needs. 

In the preferred embodiment first light source 26 is- 
placed at a first angle of 30°- 70° from the image plane and. 

2 0 second light source 2 8 is placed at a second angle of 110°- 

150° from the image plane to produce optimal results. When the 
angles become too large, i.e., tend towards the perpendicular, 
specular reflection or glare often diminishes the ability to 
distinguish the effects of defects. On the other hand, too 
25 small an angle often results in a raking-like effect which 
tends to overemphasize smaller, otherwise insignificant surface 
protrusions. Therefore, it is preferable to place the light 
sources at different angles on the axis perpendicular to the 
document 12 to be scanned. 

3 0 Data-processing system 18 is preferably an external 

processing system, such as an external computer running 
software elements, operable to receive and process captured 
image data. An example is a personal computer with an Intel 
Pentium III processor connected to scanner 16 via a universal 
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serial bus. In one embodiment, data-processing system 18 
communicates with and controls the image -capturing system. 
Connection C-5 connects data-processing system 18 to controller 
48. This allows for data-processing system 18 to control 
5 controller 4 8 and thereby control the operation of first 
electronic switch 42, second electronic switch 44 and transport 
mechanism 46. Transport mechanism 4 8 in an embodiment is 
operable to move imaging subsystem 24 along document 12 in 
order to capture the entire document. In another embodiment 

10 transport mechanism 48 is operable to move platen 22, which 
holds document 12, over sensing device 30. 

Data-processing system 18 couples to analog- to-digital 
converter 38 via line C-6. This is done so that data- 
processing system 18 can receive data detected by sensor 30. 

15 Of course, if sensing device 30 directly captures digital 
information, analog- to-digital converter 38 would not be 
needed and a direct connection can be made between sensing 
device 3 0 and data-processing system 18. The previous 
discussion is only an example of how data-processing system 18 

20 might interface with controller 48 and sensing device 30. 
Those skilled in the art will realize that other manners of 
transferring and receiving data can be used. For example, some 
or all control can be included internal to scanner 16. 

FIGURE 2 illustrates the components of data-processing 

25 system 18. Data processing system 18 preferably comprises 
processing system elements coupled via a bus 60. These 
elements include: a CPU 62; input devices 64; output devices 
66; communication interface 70; storage device 72; memory 74, 
such as random access memory or read-only memory/ or both; and 

30 computer-readable storage media reader 68. Memory 74 

preferably comprises a working memory which contains an 
operating system 76 such as Windows 98, UNIX, LINUX, Windows 
NT,- or any other computer operating system as well as image- 
processing software 78. Image-processing software 78 is 
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operable to manage image datasets generated by scanner 16 in 
accordance with the present invention. Computer -readable 
storage media reader 68 couples to computer- readable storage 
media 80 which includes local remote storage devices and a 
5 memory operable to store information. Communication interface 
70 is operable to connect to an image capture system such as 
scanner 16. Communication interface 70 is operable to both 
send and receive information to and from scanner 16. In one 
embodiment, communication interface 70 is a universal serial 

10 port interface, although other interfaces can also be used. 

Data-processing system 18 can be set up to automatically 
process captured image data through a digital image and a 
defect map and then to correct the defects using the defect map 
and digital image. Also, parameters can be supplied or 

15 developed by data-processing system 18 to be used in 
conjunction with the system. Additionally, a user can interact 
with data-processing system 18 via input device 64 such as a 
keyboard. This can be used to control the image data 
processing and for reviewing and/or modifying process 

20 parameters. Such activity is well known in the art. 

FIGURE 3 is a flowchart illustrating the overall operation 
of system 10. In step 100, document 12, such as a film print, 
is placed on the platen 22 of scanner 16, as illustrated in 
FIGURE 1. In step 102, at least two digital images are 

25 captured by data-processing system 18. These two digital 
images correspond to a first digital image produced by first 
light source 2 6 impinging on document 12 and a second digital 
image produced by second light source 28 impinging on document 
12. In one embodiment, sensing device 30 is passed over the 

30 entire document before data processing begins. In an 
embodiment, image data produced by first light source 26 
impinging on document 12 is captured. Then the image data 
produced by second light source 28 impinging on document 12 is 
captured. Alternatively, first light source 26 and second 
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light source 28 can alternate as sensing device 3 0 moves in 
such a way as a portion of document 12 is captured as image 
data each time the first light source 26 and second light 



5 information is obtained in a single scan of the entire document 
12. In other embodiments, processing can start immediately 
upon scanning a part of document 12 while other parts of 
document 12 are scanned. When sensing device 3 0 is used to 
capture both digital images, it is inherently in register for 
10 both image and defect sensing no matter which light source is 
used; 

When image side 12a of document 12 is scanned, data is 
obtained from each of a plurality of pixels that scanner 16 is 
capable of detecting. A pixel is an individual, discrete 
15 digital sample of scanner 16. The greater the number of pixel 
per unit areas that can be directly obtained to represent 
document 12, the more surface defects are detected. For 
example, a scanning resolution of 2000 pixels by 3000 pixels 
is typically considered by those skilled in the art to be full 

2 0 resolution range from 35 mm film. For a color image, a scanned 

pixel contains multiple samples; one for each color sub-sample 
such as red, green and blue. The greater the number of pixels 
per unit area, the greater clarity of the resulting image, all 
things being equal. Each pixel is represented by a plurality 
25 of bits. Typically, an 8 bit byte represents the intensity of 
light of a given color (e.g., red, green or blue) at a given 
pixel. Thus, 24 bits are typically used to represent each pixel 
in a color image. While it is desirable to have greater 
resolution, this leads to an undesirable increase in the number 

3 0 of' defects captured. Therefore, an advantage of this 

embodiment of the present invention is to remove the defects 
while leaving a high resolution image. 

" FIGURE 4 illustrates step 102 of FIGURE 3 in detail. 
While the example given in FIGURE ' 4 is of a single pass 



source 28 alternates. 



In this manner, image and defect 
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scanner, those skilled in the art will know that other ways of 
capturing image and defects are possible. For example, in step 
110, data-processing system 18 initializes the creation of two 
image datasets where image information may be stored. One 
5 dataset is for data produced by first light source 26, the 
other data set for data produced by the second light source 28. 
In step 112, controller 48 causes transport mechanism 46 to 
create relative movement between sensing device 3 0 and document 
12, thereby creating relative positioning for capturing a 

10 source image. In one embodiment, imaging subsystem 24 is moved 
by transport mechanism 46 over document 12. In conjunction 
with creating such relative positioning, controller 48 causes 
power to be applied to first light source 26, but not to second 
light source 28. This illuminates document 12 and causes any 

15 defects corresponding to document 12 or the platen 22 to create 
effects in a first, rightward direction as will be explained 
further in conjunction with FIGURE 5a. 

While illuminated, image information (preferably 
comprising image, defect and defect effect data) is collected 

20 by sensing device 30 in step 116. In step 118, the image data 
is converted to digital image data and appended to the first 
image dataset. In cases where sensing device 30 produces a 
direct digital output the step of converting the digital data 
would not be necessary and the information can be directly 

25 appended to the first imaged dataset. 

In step 120, controller 48 causes second light source 28 
to illuminate while holding first light source 26 in an off (or 
low intensity) position. This illuminates document 12 and 
causes any defects corresponding to such document 12 to create 

30 effects in a second direction, i.e., leftward, as explained in 
more detail with reference to FIGURE 5b. Then, in step 122, 
the image side 12a of document 12 is captured by sensing device 
30 and, in step 124, the image data is converted to a digital 
form and appended, to the second image dataset. Thereafter, in 
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step 126, if more of document 12 needs to be captured, the 
process continues again at step 112. 

FIGURE 5a is a simplified illustration of system 10 in 
accordance with the teachings of the present invention. 
5 Illustrated is an image 132 on document 12 with a first defect 
134 and a second defect 136, such as a piece of dirt or a 
scratch. Also illustrated is first light source 26 and second 
light source 28. The illustration in FIGURE 5a is for 
exemplary purposes only and other arrangements and 

10 configurations of light sources and images would be apparent 
to those skilled in the art. 

FIGURE 5b illustrates the system of FIGURE 5a with first 
light source 26 in the on (or high intensity) position. When 
first light source 26 is on, it illuminates image 132 and first 

15 defect 134 and second defect 136 at an angle from the left hand 
side. This produces a first defect shadow 135 and a second 
defect shadow 137 to the right of first defect 134 and second 
defect 136. No shadow is produced by image 132 since it is 
flat on the document. 

20 FIGURE 5c illustrates the system of FIGURE '5a where second 

light source 28 is in the on (or high intensity) position. 
When second light source 28 is on, it illuminates image 132 and 
first defect 134 and second defect 136 at an angle from the 
right hand side. This produces a first defect shadow 135 and 

25 a second defect shadow 137 to the left of first defect 134 and 
second defect 136. No shadow is produced by image 132 since 
it is flat on the document. 

The results of scans using both light sources, 2 6 and 28, 
are combined and analyzed by a processor. The result isolates 

30 the defects as seen in FIGURE 5d which illustrates the shadow 
of the defects isolated from the image. This "defect map" can 
then be used to achieve a digital image of document 12 
substantially free from defects. 
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FIGURES 6a and 6b represent spatial density plots showing 
digital data captured in response to the illumination of first 
light source 26 and second light source 28. The density plots 
are plotted by pixel amplitude and by pixel position. FIGURE 
5 6a represents data recorded in response to first light source 
2 6 which was placed on the left side of the image. Image data 
140 is shown as the data with amplitudes in the range of 80 to 
125 for pixel positions 400 through approximately 425. Data 
for defects 142 is shown as the pixel positions by 

10 approximately 43 5 on to nearly 4 90 which shows an amplitude 
dropped in value from pixel position 450 to pixel position 468. 
This represents a shadow which falls to the right of the 
defect. A shadow is typically caused when light is reflected,- 
before reaching part of an image, or is blocked before it.. 

15 reaches part of an image , such that the amplitude of light from 
a portion of the image is reduced. After position 468, the 
amplitude of light rises until it reaches the level of the 
image data again around position 480. Therefore, a right 
boundary 144 for a surface defect can be established at 

20 position 455 based on the shadow position. 

FIGURE 6b illustrates the data record response of second 
light source 28. This density plot shows a reverse pattern 
than from the one shown in the previous density plot. Image 
data 152 is shown with an amplitude between 80 and 12 5 at pixel 

25 values 470 to around 500. The drop in amplitude for pixel 
positions after 445 to nearly pixel position 220 at pixel 
position 432 represents a shadow falling to the right of the 
image cast- again from a defect such as a piece of dust. After 
position 432, the amplitude rises into each level of the image 

30 dataset around pixel position 420. Thus, a left boundary 154 
for a surface defect can be established at substantially 
position 445 based on the shadow position. 

With respect to FIGURES 6a and 6b, it should also be noted 
that pixel intensity values that allows the creation of such 
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density plots will be obtained for each of the colors scanned 
with respect to the same group of pixels. The data 
representing red, green and blue, as described previously, can 
be used in a variety of ways, such as individually (only one 
5 of red, green and blue from the first image and only one of 
red, green and blue from the second image used) , combined 
together (such as red, green and blue for each pixel the first 
image are combined together and red, green and blue for each 
pixel of the second image are combined together) , or in 

10 dependence upon other characteristics of the image portion 
being scanned (such as using only red and blue in the green 
portion of the image and only red and green in the blue portion 
of the image for the purpose of creating a defect map) . 

Turning back to FIGURE 4, after capturing digital image 

15 data in step 102, data-processing system 18 stores the captured 
digital image data in step 104 and processes it in step 106. 
The details of processing data are described in further detail 
in FIGURE 7. Data-processing system 18 detects the effects of 
surface defects in the captured image to identify the defects 

20 in step 106. Thereafter, the identified defects are used in 
step 108 to create a defect map that shows the boundaries of 
these defects . Further in step 108, data-processing system 

18 applies the defect map to the image and treats the defects 
as a mask. A mask is an image that selects where and by how 

25 much an image is to be altered by subsequent operations. Data- 
processing system 18 thus applies to defect region some type 
of correction to fill in defect areas in the combined image 
with data from surrounding areas. This process reduces the 
defects in the final,- enhanced image, as seen in step 110 of 

3 0 FIGURE 4. 

The detection and the identity of the defects and the 
creation of defect maps can occur in a number of ways. In one 
implementation, those pixels that have a difference between the 
maxima and minima that is greater than a threshold can be 





WO 01/28226 



PCT/US00/27979 



15 



determined to be a defect, and adjacent pixels that have a 
difference that is also greater than a threshold can be 
determined to form a defect region. A useful threshold is to 
measure the mean and standard deviation of the numerical values 



at a level. For example, in one embodiment, the threshold is 
set at three standard deviations from the mean. 

FIGURE 7 is a flow chart illustrating the processing of 
forming digital images as described in step 106 of FIGURE 4 . 

10 Initially, in step 200, the stored data images are obtained. 
In step 202, data-processing system 18 filters the digital data 
in the datasets for the two digital images captured from the 
different light sources of each portion of the image. In many : v 
applications the data-processing system 18 uses a high-pass 

15 filter for filtering. The purpose of the filter is to reduce 
the effects of irregular light sources shading. Filtering is 
not needed if the two light sources are perfectly balanced. 
A variety of filters are known to reduce the effects of w 
irregular light source shading. A useful filter is the - 

20 difference between the original image and the low-pass version 
of the image created through a Gaussian filter with a radius 
of five pixels. 

Once the data has been filtered, in steps 2 04 and 2 06, the 
minimum and maximum of the two corresponding pixels and each 

2 5 of the two captured digital images are obtained. The 

corresponding pixels are the pixels that are sensed from 
substantially the same physical location on the substrate. The 
maxima is the highest pixel intensity of the pixel pairs and 
the minima is the smallest intensity. When red, green and blue 

3 0 signals are captured there would be pixel values for each color 

channel. In steps 2 04 and 2 06, data-processing system 18 finds 
the maximum and minimum amplitude intensity for the pixel 
pairs. By obtaining the maxima and the minima, it is possible 



5 of pixels of the entire image and then setting the threshold 
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to obtain density plots of the maximum and minimum. These 
density plots are illustrated in FIGURES 8a and 8b. 

FIGURE 8a illustrates the maximum pixel intensity for each 
pixel and FIGURE 8b illustrates the minimum pixel intensity for 
5 each pixel. In step 208, the difference between the maximum 
and minimum is obtained. By obtaining this difference, it is 
possible to obtain a density plot of the difference between a 
maximum and a minimum. Such a density plot is illustrated in 
FIGURE 8c. As is apparent from FIGURE 8c, the difference 

10 between the minimum and the maximum is a center region 250 
having a small difference value which corresponds to the center 
region of the defect, which on either side of the center region 
will be a very large difference value. The large value 
difference exists due to the fact that light from each side of 

15 the pixel will cast a shadow in the opposite direction and 
therefore the difference between the maximum and the minimum 
on the opposite side of the defects will be large. Note that 
the operations of steps 204, 206 and 208 can be implemented in 
a variety of different manners of those skilled in the art. 

2 0 As will be apparent to one of ordinary skill in the art, the 
maximum of the two pixels minus the minimum of the two pixels 
is equivalent to the absolute value of one pixel minus the 
other. 

In step 210, the differences of each pixel are used to 
25 create a defect map in which adjacent pixels, each indicative 
of a defect at the pixel level, are combined. This forms a 
region of pixels corresponding to a single defect. As can be 
seen in the difference between the density plots of FIGURES 8c 
and 8d, clusters of pixels will be operated upon, such that the 
30 maximum pixel difference value in the cluster will be assigned 
to all the pixels in the cluster, so long as the pixel values 
do not exceed a lower threshold value 816 such as an amplitude 
of 35. The lowest threshold value is used to indicate that if 
a pixel has a value below that threshold it does not contain 
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a defect. The lower threshold value is empirically determined. 
Using this regional maximum tends to linearize ...portions of the 
density plot, which can be seen in FIGURE 8d, and also aids in 
establishing more accurate borders 254 of the defect. For 
5 example, the first three pixels in FIGURE 8c have different 
amplitude values. By considering these pixels to be part of 
the same cluster, we assign them the same value. This can be 
seen by examining the first three pixels of 8d. These pixels 
now have the same intensity value. This allows for differences 

10 in amplitudes to be determined more distinctly and therefore 
• leads to a more accurate determination of borders. 
In determining the defect map, the present invention also 
applies an upper threshold value 252 to the difference data to 
obtain a mask of the areas that correspond to a defect. Thus, 

15 all pixel locations have a difference value that is greater 
than the upper threshold value 252, which in this example is 
75, will be considered to contain a pure defect and can be 
fully corrected as described below. 

The area between the thresholds , considered to contain a 

20 partial defect, will be partially corrected, to avoid hard 
edges, as described below. While the upper threshold value, 
with an amplitude of 75, and the lower threshold value, with 
an amplitude of 35, have been found useful, other values can 
be used. It should be noted, therefore, that the defect map 

25 contains information not only to the presence or absence of 
defects, but also to the degree to which a defect exists. This 
helps, as will be appreciated by those of ordinary skill in the 
art, in blending together regions that do not contain a defect 
with adjacent regions that do contain a defect. While FIGURES 

30 6a, 6b, 8a, 8b, 8c and 8d illustrate the use of density plots 
to locate defects, other graphical representations could also 
be used to analyze the data. 

In addition to the line scanner 16 shown in FIGURE 1, 
numerous other image -capturing devices and/or device 
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configurations can also be used in accordance with particular 
applications and source media for the present invention. For 
example, such alternatives can comprise drum- type document 
scanners, film scanners, page scanners, integrated circuit 
5 printers, film-developing systems, and other types of image- 
capturing devices. Such devices might further utilize a wide 
variety of sensors, sensor components, and sources of 
electromagnetic radiation, and other components, as is 
appropriate to a particular application. Many other image- 

10 processing alternatives can also be utilized. 

For example, FIGURE 9 illustrates an embodiment with 
similar components to those in FIGURE 1, but that captures data 
from a substrate that is transparent or semi transparent 
document (such as film 2 3 or an overhead projection slide) 

15 using a transmisive scanner 12. In this embodiment, the light 
sources are on one side of the substrate and the sensing device 
is on the other side of the substrate. The sensing device will 
detect light from the light sources after interacting with the 
medium. 

20 Those skilled in the art will also appreciate that 

alternative scan-cycle configurations can be utilized with line 
scanner 16 (FIGURE 1) , as well as with other image -capturing 
devices. For example, where only two light sources have been 
discussed previously, more than two light sources can be used 

25 to produce multiple datasets that might be useful in 
identifying defects. 

Another example is that scanning can be conducted using 
"multiple-pass" scanning techniques, i.e., wherein relative 
positioning corresponds to movement over at least a portion of 

30 a source image more than once. Multiple-pass scanning can also 
be conducted uni -direct ionally (i.e., where capturing occurs 
in conjunction with movement in only one direction) or multi- 
directionally (i.e., where capturing occurs in conjunction with 
movement in more than one direction) . However, image capturing 
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provides at least two image datasets, corresponding to 
illumination from at least two separately illuminated light 
sources . 

A number of other types of light sources can also be 
5 utilized in accordance with a particular application of the 
present invention, such as light emitting diodes (LEDs) , 
multiple separate light sources, and arrayed light sources. 
Lights of different wavelengths besides fluorescent, such as 
infrared (IR) , near infrared (NIR) , and ultraviolet (UV) , can 
10 be used. Different wavelengths can be used for each separate 
light source. 

For example, if the substrate is scanned using a light _ 
having a wavelength in a part of the spectrum that reflects 
very little light off a substrate, the present invention tends 

15 to distinguish defects where there are specular highlights. - 
If the substrate is scanned using light having a wavelength 
where the substrate is highly reflective, the present invention 
tends to ^distinguish defects by shadows. If the substrate is 
red, for example, a light source using red light will .. 

2 0 distinguish shadows, whereas a light source using green light 
will distinguish the specular highlights. Since most 

substrates become fairly dark in ultraviolet light, the use of 
an additional light source of ultraviolet light can be used to 
distinguish the spectral highlights. Similarly, since most 

25 substrates become very light in infrared light, an additional 
light source of infrared light can be used to distinguish 
shadows. Accordingly, different combinations of light sources 
can be used according to the present invention. 

In addition, a mirror can be used as a light source by 

30 redirecting light from one or more other light sources. . For 
example, FIGURE 10 illustrates an. embodiment with similar 
components to those in FIGURE 1, but that captures data from 
a substrate that is a reflective medium 12 using a mirror 27 
as a second light source. Controller 48 directs light from a 
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first light source 26 to mirror 27. Two shutters 25 control 
the illumination from first light source 26 and mirror 27 to 
permit the capture of two digital images from different 
positions . 

5 It will also be appreciated that more than two light 

sources can be used and will be preferred in accordance with 
certain applications and hardware configurations. With other 
applications and hardware configurations, more than two lights 
may be useful. For example, FIGURE 11 illustrates an 

10 arrangement of three light sources 262, 264, and 266, used 
with a drum scanner 268. With such an arrangement, the present 
invention teaches the usefulness of placing the three light 
sources at angles of approximately 12 0° from each other. In 
this arrangement, the maxima and minima of all three light 

15 sources for a given pixel can be used to determine the 
difference that will be used for identification of a defect. 
FIGURE 12 illustrates another arrangement of four light sources 
used in a flatbed scanner 22 configuration. In this 
embodiment, the present invention teaches the usefulness of 

20 placing the four light sources, 272, 274, 276 and 278, at 
angles of substantially 90° from each other. In this 
arrangement, the maxima and minima of all four light sources 
for a given pixel can be used to determine the difference that 
will be used for identification of a defect. As will be 

25 appreciated, having light from different angles will increase 
the accuracy of the detected borders of a particular defect. 
Other light source configurations can also be used with still 
larger numbers of light sources. 

It will also be appreciated that a single light source can 

3 0 also be used to provide illumination from multiple directions 
by relatively re-positioning scanner 16 elements (in FIGURE 1) 
and/or by adding one or more sensors. Moving the single light 
source to a different position in such a way makes it virtually 
a second light source. 
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It will be also appreciated that where a different image- 
capturing device or device configuration than line scanner 16 
is utilized, relative repositioning of the device elements 
might be conducted in a substantially different manner 
5 consistent with the- device and/or application. For example, 
a particular image -capturing device might operate more 
effectively through movement of a single element or a different 
element grouping, such as platen 22 and/or a source medium 
(e.g., document 12) . A given device might further utilize one 

10 light source or more than two light sources, as discussed 
above. A given application might further benefit from 
capturing a different image portion {e.g., pixel, grouping of., 
pixels, lengthwise partial line, etc.), among other examples. .;■ 
Therefore, while reference might be made herein to "movement" \. 

15 of one or more specific system elements and/or in a particular ; 
manner, any such references includes any relative re- 
positioning of applicable elements whereby capturing is \. 
provided in a manner consistent with the teachings herein. 
Mechanisms for moving a document, platen, sensor, mirror or 

20 combination of elements in one or more directions, for example, 
are well known in the art of copiers, printers, scanners, 
facsimile machines and other devices. 

It will be apparent to those skilled in the art that 
variations of data-processing system 18 (FIGURES 1 and 2) can 

2 5 be made, and that the embodiments mentioned herein are 
considered representative. For example, many elements, such 
as data -processing system 18 (and/or its component elements) , 
can be implemented in software, hardware or a combination of 
both. Another example is that - such processing- system 

30 alternatives as multiple systems, CPUs, dedicated 
microprocessors, and/or digital signal processors ( "DSPs" ) 
among others, might be used. A further example is that sources 
of image data other than or in addition to an image -capturing 
system (e.g., stored images, transferred images and/or 
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processed data) can be utilized. Communications interface 70 
(as seen in FIGURE 2) can still further comprise any number of 
wired and/or wireless connections to a local and/or wide area 
network, the Internet and/or other connectable devices and/or 



transfer, sharing, workload distribution, downloadable code 
and/or data, and other capabilities, as are continuously being 
introduced, advanced and more widely adopted. Various input 
and output devices can also be used; however, output devices 

10 preferably include an image printer and at least one image 
viewing device, such as a CRT and/or flat panel display. Still 
further, various operating systems and data-processing systems 
can be utilized. In one embodiment, a conventional 

multitasking operating system such as Windows 95 or Windows NT 

15 running on a computer with a Pentium II processor, is presumed 
for the discussion herein. 

Although the present invention has been described in 
detail with reference to the preferred embodiments thereof, 
those skilled in the art will appreciate that various other 

20 substitutions and modifications can be made to the examples 
described herein while remaining within the spirit and scope 
of the invention as defined in the appended claims. 



5 systems . 



Such connections enable a vast array of data 
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WHAT IS CLAIMED IS: 

1. An imaging system comprising: 

a first light source operable to illuminate an image 
plane in a first direction; 
5 a second light source operable to illuminate the 

image plane from a second direction; 

a sensing device operable to detect light from the 
first light source and second light source that interacted with 
the image plane; and, 
10 a processor operable to receive information from the 

sensing device and determine an image and image defects. 

2. . The system of Claim 1, wherein the first and second,, 
light source are fluorescent light sources. . „ 

15 

3 . The system of Claim 1 , wherein one of the light 
sources is an infrared light source. 

4. The system of Claim .1, wherein one of the light,. 
2 0 sources is an ultraviolet light source. • 

5. The system of Claim 1, wherein the first light source 
is set at a predetermined angle between 3 0 and 7 0 degrees from 
an image plane and the second light source is set at a 

25 predetermined angle between 110 and 150 degrees from an image 
plane. 

6. The system of Claim 1, wherein the image plane 
comprises a document. 

30 

7. The system of Claim 1, wherein the image plane 
comprises a platen in the imaging system. 
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8. The system of Claim 1, further comprising a transport 
mechanism and a controller. 

9. The system of Claim 8, wherein the transport 
5 mechanism is operable to move the sensing device across the 

image plane. 

10. The system of Claim 1, wherein the second light 
source comprises a reflective surface operable to receive light 

10 from the first light source and reflect the light to illuminate 
the image plane. 

11. The system of Claim 10, further comprising shutters 
placed between the first light source and the image plane and 

15 the second light source and the image plane, the shutters 
operable to control the illumination of the image plane. 

12. The system of Claim 1, further comprising a third 
light source operable to illuminate the image plane, the 

20 sensory device operable to detect light impinging the image 
plane from the first light source, the second light source and 
the third light source. 

13. The system of Claim 12, wherein the light sources are 
25 set at a predetermined angle of substantially 120 degrees from 

each other. 

14. The system of Claim 13, wherein the first light 
source, the second light source and the third light source are 

30 associated with a drum scanner. 
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15. The system of Claim 1, further comprising a third 
light source and a fourth light source, the scanning device 
operable to detect light from the third light source and fourth 
light source which have been influenced by the image plane. 

5 

16. The system of Claim 15 , wherein the light sources are 
spaced substantially 90 degrees from each other. 

17. The system of Claim 1, wherein the first light source 
10 and second light source comprise a first mirror and a second 

mirror operable to focus light from a common source. 

18. The system of Claim 1, wherein the sensing device is-, 
placed behind the image plane and the image plane is rT 

15 substantially transparent. 

19. The system of Claim 1, wherein the processor operates 
to correct the image based on the image defects. 

20 20. A method for obtaining an image and defect data 

comprising: 

producing a first record image of a source document by 
illuminating a source document from a first direction, the 
illumination interacting with the source document; 
25 producing a second record image of the source document by 

illuminating the source document from a second direction, the 
illumination interacting with the source document ; 

using the first record image and the second record image 
to reproduce an image of the source document and a defect map. 

30 
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21. The method of Claim 20, wherein the step of using the 
first record further comprises the steps of: 

detecting the illumination after interacting with the 
source document from the first direction and the second 
5 direction to form the first record and the second record; 

processing the records to form the image and the defect 

map . 

22. The method of Claim 20, wherein the steps of 
10 producing a first record image and producing a second record 

image further comprises: 

using a first light source to illuminate the source 
document from the first direction; and 

using a second light source to illuminate the source 
15 document from the second direction. 

23. The method of Claim 22, wherein the steps of using 
a first light source and using a second light source comprises 
using a fluorescent light source as a first light source and 

20 using a fluorescent light source as a second light source. 

24. The method of Claim 22, wherein the steps of using 
a first light source and using a second light source comprises 
using an infrared light source for at least one of the light 

2 5 sources . 

25. The method of Claim 20, wherein the steps of using 
a first light source and using a second light source further 
comprises using an ultraviolet light source for at least one 

30 of the light sources. 
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26. The method of Claim 20, wherein the steps of using 
a first light source and using a first light source further 
comprises using an infrared light source for at least one of 
the light sources further comprises: 
5 setting the first light source at a predetermined angle 

between 3 0 and 70 degrees from an image plane; and, 

setting the second light source at a predetermined angle 
between 110 and 150 degrees from an image plane. 

10 27. The method of Claim 20, wherein the steps of 

producing a first record image and producing a second record 
image further comprises moving a sensing device over the 
document . 

15 28. The method of Claim 20, wherein the steps of 

producing a first record image and producing a second record 

image further comprises; 

providing a first light source to illuminate the source 

document from a first direction; 
20 providing a reflective surface operable to receive light 

from the first light source and reflect the light to illuminate 

the document from a second direction. 

29. The method of Claim 20, further comprising the step 
25 of producing a third record image of the source document by 
illuminating the source document from a third direction. 
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30. The method of Claim 20, wherein the steps of 
producing a first record image and producing a second record 
image further comprises: 

using a common source of light to reflect light off a 
5 first mirror to illuminate the source document from a first 
direction; and, 



32. The method of Claim 31, wherein a defect area is 
15 defined within the image; and, 

the defect area is corrected by filling in the defect area 
with an average value obtained from the pixels surrounding but 
not including the defect area. 

20 33. The method of Claim 31, wherein the image is 

corrected by increasing an intensity of each image pixel by an 
amount proportional to the intensity of each defect pixel. 



image plane in a first direction; 

a second light source operable to illuminate the image 
plane in a second direction; 

a sensing device operable to detect light reflected by the 
3 0 image plane and to detect light from the second light source 
reflected from the image plane; and, 

wherein illumination from the first light source and the 
second light source are applied at separate times. 



using the common source of light to reflect light off a 
second mirror to illuminate the source document from a second 



direction. 



10 



31. The method of Claim 20, further comprising: 
correcting the image using the defect map. 



25 



34. A scanner comprising: 

a first light source operable to illuminate an 



— p 
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35. The scanner of Claim 34, wherein the first and second 
light source are fluorescent light sources. 

36. The scanner of Claim 34, wherein one of the light 
5 sources is an ultraviolet light source. 

37. The scanner of Claim 34, wherein the first light 
source is set at a predetermined angle between 30 and 70 
degrees from an image plane and the second light source is set 

10 at a predetermined angle between 110 and 150 degrees from the 
image plane . 

38. The scanner of Claim 34, further comprising a. 
transport mechanism and a controller. 

15 

39. The scanner of Claim 34, further comprising a 
transport mechanism operable to move the sensing device over 
the image plane. 

20 40.. . The. scanner of Claim 34, wherein the second light 

source comprises a reflective surface operable to receive light 
from the first light source and reflect the light to illuminate 
the image plane. 

41. The scanner of Claim 34, further comprising a third 
light source operable to illuminate the image plane, the 
sensory device operable to detect light impinging the image 
plane from the first light source, the second light source and 
the third light source. 

42. The scanner of Claim 41, wherein the light sources 
are set at a predetermined angle of substantially 12 0 degrees 
from each other. 



25 



30 
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43. The scanner of Claim 
source and second light source 
second mirror operable to focus 



34, wherein the first light 
comprise a first mirror and a 
light from a common source. 



5 44. The scanner of Claim 34, further comprising a 

processor operable to identify defect information using the 
difference in intensity of matching pixels in the first image 
record and the second image record. 

10 45. The scanner of Claim 44, wherein the difference in 

intensity of matching pixels are used to form a defect map. 

46. The scanner of Claim 44, wherein the processor is 
also operable to correct the first image record using the 
15 defect information. 



47. The system of Claim 44, wherein the processor is also 
operable to correct the first image record by increasing an 
intensity of each first image record pixel by an amount 

20 proportional to the intensity of each matching defect pixel. 

48. A method for acquiring a digital representation of 
an image plane comprising: 

illuminating the image plane using a first light 
25 source from a first direction; 

illuminating the image plane using a second light 
source from a second direction; 

detecting the light interacting with the image plane from 
the first light source; 
3 0 detecting the light interacting with the image plane from 

the second light source . 
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49. The method of Claim 48, further comprising- the steps 

of: 

creating a first image record from the detected 
interaction of the first light source with the image plane; 
5 creating a second image record from the detected 

interaction of the second light source with the image plane; 

processing the records to form an image and a defect map. 

50. The method of Claim 48, wherein the steps of 
10 detecting the light interacting with the image plane comprises 

detecting light reflected from the image plane. 

51. The method of Claim 48, wherein the steps of 
detecting the light interacting with the image plane comprises 

15 in part, detecting light transmitted through the image plane. 

52. The method of Claim 49, further comprising: 
correcting the image using the defect map. 

20 53. .The method of Claim 52, wherein a - defect area is 

defined within the image; and, 

the defect area is corrected by filling in the defect area 
with an average value obtained from the pixels surrounding, but 
not including, the defect area. 

25 

54. The method of Claim 52, wherein the image is 
corrected by increasing an intensity of each image pixel by an 
amount proportional to the intensity of each matching defect 
pixel . 

30 
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55. An imaging defect detection system comprising 

a first light source operable to illuminate an image 
plane from a first direction; 

a second light source operable to illuminate an image 
5 plane from a second direction; 

a sensing system operable to detect light from the first 
light source and second light source that interacted with the 
image plane; 

a processor operable to receive information from the 
10 sensing system and form a first image record from the light 
interacting with the image plane from the first light source 
and form a second image record from the second light source ; 
and, 

wherein defects are located by comparing the first 
15 data record and the second data record. 

56. The system of Claim 55, wherein the image plane 
comprises a document . 

20 57. The system of Claim 55, wherein the image plane 

comprises a platen. 

58. The system of Claim 55, wherein the processor is also 
operable to correct the first image record using the location 
25 of the defects. 

59: The system of Claim 55, wherein the processor is also 
operable to correct the first image record by increasing an 
intensity of each first image record pixel by an amount 
30 proportional to the intensity of each matching defect pixel. 
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60. The system of Claim 55 , further comprising a third 
light source operable to illuminate the image plane, the 
sensory device operable to detect light impinging the image 
plane from the first light source, the second light source and 

5 the third light source. 

61. A method for determining a defect record of an image 
pi ane compr i s ing : 

obtaining a first image record based on light influenced 
10 by the image plane from a first light source; 

obtaining a second image record based on light influenced 

by the image plane from a second light source; 

obtaining a maximum pixel intensity record by comparing 

the first and second image records and selecting the highest^ 
15 pixel intensity value for a given pixel location; 

obtaining a minimum pixel intensity record by comparing 

the first and second image records and selecting the lowest 

pixel intensity value for a given pixel locations- 
obtaining a difference record by subtracting the minimum 
20 pixel- intensity record from the maximum pixel intensity values- 
locating the center of a defect region by locating 

localized minimums in the difference record; and 

determining defect boundaries based on the difference 

record. 

25 

62. The method of Claim 61, further comprising: 
determining upper and lower pixel intensity values from 

the difference record; and 

labeling pixels as defective based on the upper and lower 
3 0 thresholds and the defect boundaries. 

63. The system of Claim 61, wherein the image plane 
comprises a document . 
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64. The system of Claim 61, wherein the image plane 
comprises a platen. 

65. The method of Claim 61, further comprising: 

5 correcting the image using the defect boundaries and 

di f f erence record . 

66. The method of Claim 65, wherein the defect region is 
corrected by increasing an intensity of each first image 

10 record pixel in the defect region by an amount proportional to 
the intensity of each matching defect pixel . 

67. A method for locating image defects comprising: 
locating shadow pixels in a first image record; 

15 locating shadow pixels in a second image record; 

comparing the shadow pixel regions to form defect 
boundaries; and, 

forming a defect map based on the defect boundaries. 

20 68. The method of Claim 67, further comprising: 

correcting the image using the defect map. 

69. The method of Claim 68, wherein the first image 
record is corrected by increasing an intensity of each first 
2 5 image record pixel by an amount proportional to the intensity 
of each defect pixel . 
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